Modelling savings behavior of agents in the kinetic exchange models of market 



Anindya S. Chakrabarti 
Indian Statistical Institute, 203 B. T. Road, Kolkata-700108 
(Dated: June 28, 2010) 

Kinetic exchange models have been successful in explaining the shape of the income/ wealth dis- 
tribution in the economies. However, such models usually make some ad-hoc assumptions when it 
comes to determining the savings factor. Here, we examine a few models in and out of the domain 
of standard neo-classical economics to explain the savings behavior of the agents. A number of 
new results are derived and the rest conform with those obtained earlier. Connections are estab- 
lished between the reinforcement choice and strategic choice models with the usual kinetic exchange 
models. 
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I. INTRODUCTION 

The distributions of income and wealth have long been 
found to possess some robust and stable features inde- 
pendent of the specific economic, social and political con- 
ditions of the economies. Traditionally, the economists 
have preferred to model the left tail and the mode of the 
distributions of the workers' incomes with a log-normal 
distribution and the heavier right tail with a Pareto dis- 
tribution. For a detailed survey of the distributions used 
to fit the income and wealth data see Ref. However, 
there have been several studies recently that argue that 
the left tail and the mode of the distribution fit well with 
the gamma distribution and the right tail of the distribu- 
tion follows a power law [H-Ql. It has been argued that 
this feature rnight be considered to be a natural law for 
economics 0, • 

The Chakraborti-Chakrabarti Q model (CC model 
henceforth) can explain the gamma-like distribution 
very well whereas the Chatterjee-Chakrabarti-Manna [7] 
model (CCM model henceforth) explains the origin of 
the power law. Both models fall in the category of the ki- 
netic exchange models. However, the first model assumes 
a constant savings propensity and the second model as- 
sumes an uniformly distributed savings propensity of the 
agents. It may be noted that the distribution of the sav- 
ings factor is exogenous in these models. It is not derived 
from any optimization on the agent's part or by some 
other mechanism. 

Ref. [s^] considers an exchange economy populated 
with agents having a particular type of utility function 
and derives the CC model in the settings of a competitive 
market. Here, we show that the same methodology could 
be applied to derive the CCM model and we can explain 
the savings factor accordingly. A further possibility is 
also studied where the constancy of the savings propen- 
sity over time is relaxed. More specifically, we examine 
the cases where the savings propensity is dependent on 
the current money holding of the corresponding agent. 
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This model, as we shall see, shows self-organization and 
in some cases, it gives rise to bimodality in the money 
distribution. 

It is well known the models of utility maximization has 
been severely critisized on the grounds of limitations of 
computational capability of human beings [9|. Hence, 
to model the savings behavior of the agents, we study 
some simple thumb-rules and derive the distributions of 
savings therefrom and finally the income/wealth distri- 
bution. In particular, we consider the savings propensity 
as a strategy variable to the agents. Two cases are ex- 
plored here. In the first case, the agents take their savings 
decisions of their own by reinforcing their choices. In the 
second case, the agents adopt the winning strategy. In 
all cases, we study the final money distributions. 

The plan of this paper is as follows. In section, |ll] we 
explain the savings behavior of the agents using argu- 
ments from neoclassical economics. In the next section, 
we study a self-organizing market where the savings is a 
function of the current money holding of the correspond- 
ing agent. In section |V] and IVI) we study the savings 
behavior of the agents where the savings decision follows 
some very simple thumb-rules. Then follows a summary 
and discussion. 



II. KINETIC EXCHANGE MODELS IN A 
COMPETITIVE MARKET 



By competitive market we mean a market with atomistic 
agents who trade with each other knowing that their in- 
dividual actions can not possibly influence the market 
outcome (that implies there is no strategic interaction be- 
tween the agents). We assume that markets are always 
cleared by equating supply and demand; that is the mar- 
ket is completely free of any friction. Below, we elaborate 
on the market structure and the behavior of the agents 
more explicitly. 
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A. The Chakraborti-Chakrabarti (CC) Model 

This model considers homogenous agents characterized 
by a single savings propensity. We briefly review the 
derivation of the model following Ref. [1] . The structure 
of the economy is the following. It is an exchange econ- 
omy populated with TV agents each producing a single 
perishable commodity. There is complete specialization 
in production which means none of the agents produce 
the commodity produced by another. Money is not pro- 
duced in the economy. All agents are endowed with a 
certain amount of money at the very begining of all trad- 
ings. Money can be treated as a non-perishable com- 
modity which facilitates transactions. All commodities 
along with money can enter the utility function of any 
agent as arguments. These agents care for their future 
consumptions and hence they care about their savings 
in the current period as well. It is natural that with 
successive tradings their money-holding will change with 
time. At each time step, two agents are chosen at ran- 
dom to carry out transactions among themselves compet- 
itively. We also assume that the preference structure of 
the agents are time-dependent that is the par ameters of 
the utility functions vary over time (Ref. |lOl. fllj). For 
a detailed discussion on the derivation of the resulting 
money-transfer equations, see Ref. Below, we pro- 
vide the formal structure and the solution to the model 
only. 

Let us assume that at time t, agent i and j have been 
chosen. Also, assume that agent i produces Qi amount 
of commodity i only and agent j produces Qj amount 
of commodity j only and the amounts of money in their 
possession at time t are (t) and rrij (t) respectively (for 
simplicity, mfe(O) = 1 for fc=l,2). Notice that the notion 
of complete specialization in production process provides 
the agents with a reason for trading with each other. 
Naturally, at each time step there would be a net transfer 
of money from one agent to the other due to trade. Our 
focus is on how the amounts money held by the agents 
change over time due to the repetition of such a trading 
process. For notational convenience, we denote rnfc(t + 1) 
as rrife and mk{t) as Mk (for k = 1,2). 
Utility functions are defined as follows. For agent 
i, Ui{xi,x-j,mi) = 



x^^Xj^nii and for agent j, 
where the arguments in both 



of the utility functions are consumption of the first (i.e., 
Xi and j/i) and second good (i.e., Xj and yj) and amount 
of money in their possession respectively. For simplic- 
ity, we assume that the sum of the powers is normal- 
ized to 1 i.e., ai -|- a2 -l- A = 1. Let the commod- 
ity prices to be determined in the market be denoted 
by Pi and pj. Now, we can define the budget con- 
straints as follows. For agent i the budget constraint 
is piXi + pjXj -\- TTii < Mi + PiQi and similarly, for agent 



j the constraint is piyi +Pjyj 



-pjQj. In this 




set-up, we get the market clearing price vector {pi,pj) as 

Pk = (afc/A)(M, + Mj)/Qk for A: = 1, 2. 

By substituting the demand functions of Xk , yk and pk for 



FIG. 1; 

The usual CC model: money distribution among the agents. 
Four cases are shown above, viz., A = (+), A — 0.2 (x), 
A — 0.5 ( *), A = 0.8 (□). All simulations are done for 
0(10®) time steps with 100 agents and averaged over O(IO^) 
time steps. 



= 1, 2 in the money demand functions, we get the most 
important equation of money exchange in this model. To 
get the final result, we substitute aijipn + Q;j) by e to get 
the money evolution equations as 

mi(i + l) = Ami(<) + e(l - A)(mi(i) + mj(i)) 
TOj(i + l) = Amj(f) + (1 - e)(l - A)(TOi(t) +TOj(i)) 

(1) 

where mk(t) = Mk and mk(t -I- 1) = mk (for A:= i, j). 
Note that for a fixed value of A, if oti is a random variable 
with uniform distribution over the domain [0, 1 — A], then 
e is also uniformly distributed over the domain [0, 1]. For 
the limiting value of A in the utility function (i.e., A — > 
0), we get the money transfer equation describing the 
random sharing of money without savings. 

Interpretation of A: Here, it is clearly shown that A 
in the CC model is nothing but the power of money in the 
utility function of the agents and finally this turns out to 
be the fraction of money holding that remains unaffected 
by the trading action. However, in this form it can not 
be directly interpreted as the propensity to save. Below, 
we try to derive A from an utlity maximization problem 
while retaining the kinetic exchange structure and we 
show that in this slightly alternative formulation, A is 
indeed the savings propensity as has been postulated. 



B. The Chatterjee-Chakrabarti-Manna (CCM) 
Model 

As is clear from above, in the CC model the savings deci- 
sion, the market clearence, the prices are all determined 
at the same instant. But the savings decision is usually 
made in separation. More specifically, we can model the 
savings decision and the market clearence distinctly. The 
CCM model takes into account the heterogeneity of the 
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agents. In particular, it assumes that it is the savings 
propensity of the agents which differs from each other. 
To derive the same, we assume that the agents take de- 
cisions in two steps. First, they decide how much to save 
and in the second step, they go to the market with the 
rest of the money and take the trading decisions. 
Formahy, we can analyze a typical agent's behavior at 
any time step t in the following two steps. 

(i) Each agent's problem is to make the decision re- 
garding how much to save. For simplicity, we as- 
sume that the utility function is of Cobb-Douglas 
type. Briefly, at time t the i~th agent's prob- 
lem is to maximize U{ft,Ct) = ft^c]^ subject 
to /t/(l -f r) + Q = m{t) where / is the amount 
of money kept for future consumption, c is the 
amount of money to be used for current consump- 
tion, m(t) is the amount of money holding at time 
t and r is the interest rate prevailing in the market 
which can be assumed to be zero in a conservative 
framework. This is a standard utility maximization 
problem and solving it by Lagrange multiplier, we 
get the optimal allocation for the i—th agent as 
/(* = Xivnit) and = (1 - Xi)m{t). Clearly, this 
decision is independent of what other agents are do- 
ing. So now the agents will go to the market with 
(1 - \i)m{t) only. 

(ii) Now that each agent has made the savings deci- 
sion, they can engage in competitive trade with 
each other in the fashion descibed in subsection 
III Al with A — ?• (but A ^ 0; it is a mathemati- 
cal requirement). Note that the amount of money 
used by the j-th agent is Cj = (1 — Ai)m(i) only. 

The resultant asset exchange equations are those 
given by the CCM model [7]. 

m,{t + l) = \mi{t) + e[{l - K)vH{t) + 
(1-A,)m,(i)] 

mj{t + 1) = AjTOzW + (1 - e)[(l - \i)m,{t) + 
{l-\,)m,{t)] 

(2) 

Interpretation of A^: First we recall the solution of 
the savings decision which is J^ = Xim{t). Note that it 
implies 

A --^ 

' ~ m{t) 

that is Xi is nothing but the proportion of money kept 
for future usage to the current money holding and this is 
by definition the savings propensity. 

III. A AS A FUNCTION OF MONEY: A 
SELF-ORGANIZING ECONOMY 

A distinct possibility is that the savings propensity 
is a function of money-holding itself. To examine 
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FIG. 2; 

The usual CCM model: money distribution among the 
agents. All simulations are done for O(IO^) time steps with 
100 agents and averaged over O(IO^) time steps. The 
straight line is a guide for a power law with slope -2. 



that case, we need A:[0,cxd)— !'[0,1]. However, there 
are two possibilities. The savings propensity can be 
an increasing or decreasing function of money-holding. 
The simplest forms that we may assume are the following. 

(i) At = Cie~^'^^™^*^^ with ci <1: Savings propensity 
is a decreasing function of money holding. The re- 
striction on ci does not allow any agent to have 
savings propensity equals to 1. The system shows 
self-organization and assumes a stable probability 
density function in the steady state (See Fig. [3] 
where, for purpose of illustration, ci has been kept 
constant at 0.95). It is seen numerically that as 
C2 increases the distribution converges to an expo- 
nential density function. In the other extreme, it 
tends to the CC model with A = ci. For moder- 
ate values of C2 , the distribution resembles gamma 
function. For other values of ci also, the system 
behaves similarly. Note that since ci is the max- 
imum possible savings propensity, for a very low 
value of it, the system becomes indistinguishable 
from an exponential distribution. While it seems 
counter-intuitive that savings propensity falls with 
the money holding, this might in fact be possible 
since poorer people can not take any chance to gam- 
ble whereas richer people can. 

(ii) At — ci(l — e^^'^^™^*^^) withci < 1: Savings propen- 
sity is an increasing function of money holding. The 
economy again organizes itself and the distribution 
of money becomes stable over time. However, there 
is something more. It is seen numerically that bi- 
modality may apper spontaneously in the density 
function of money. See Fig. S) Ref. [121 discusses 
such bimodal distribution of wealth (or money). 
There a mixture of the agents was used where two 
classes of agents were characterized by two different 
and widely separated (but fixed!) savings propen- 
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ture of this model is that keeping ci constant as 
C2 increases, the monomodal distribution breaks 
into a bimodal distribution which again becomes 
a monomodal distribution for even larger values of 
C2. For example, consider Fig. 3] in which the 
maximum value of ci considered is 4. But as C2 
increases further, the distribution again becomes 
monomodal. However, it should also be mentioned 
that if ci is too large (for example, if c\ > 0.97), 
then the system produces some strange-looking bi- 
modal distributions. 



FIG. 3: 

Savings propensity is negatively related to the level of 
money. All simulations are done for O(IO^) time steps with 
100 agents and averaged over 0(10"^) time steps. Here, ci 
has been kept constant at 0.95 and C2 has been changed. 
The plots include C2= 0.1 (+), 0.5 (x), 1 ( *), 2 (□), 4 (■). 
It is seen that as C2 increases, the distribution becomes more 
and more skewed finally converging to an exponential 
density function. 




FIG. 4: 

Savings propensity is positively related to the level of 
money. All simulations are done for O(IO^) time steps with 

100 agents and averaged over 0(10'^) time steps. Here, 
ci=0.95 and the curves are plotted for 02— 1 (+), 2 (x), 3 
( *) and 4 (□). Bimodality is clearly seen in the distribution 
of money. 



IV. 'IRRATIONAL' DECISION MAKING 

The standard economic paradigm of market clearence via 
utility maximization has been criticised on the grounds of 
limitations of computational capability of human beings 
0. The main challenge is to derive the homogeneity in 
savings behavior of the agents from a very simple thumb- 
rule such that the final distribution of income/wealth 
looks realistic. A few realistic components of decision- 
making are noted in Ref. [3, [l^ 

(i) Players develop prefernces for choices associated 
with better outcomes even though the association 
may be coincident, causally spurious, or supersti- 
tious. 

(ii) Decisions are driven by the two simultaneous and 
distinct mechanisms of reward and punishment, 
which are known to operate ubiquitously in hu- 
mans. 

(iii) Satisficing or persisting in a strategy that yields a 
positive but not optimal outcome, is common and 
indicates a mechanism of reinforcement rather than 
optimization. 

Of particular interest is item (iii) which goes directly 
against the derivations stated above (see Section HI)) . 



FROM ONE TO MANY 



sities. Such a segregated population gave rise to 
bimodal distributions. However, such segregations 
are exogenous since the As are given from outside 
the system. Here, however, we have a new model 
in which savings decision is completely endogenous 
and the economy organizes itself in such a way that 
it gives rise to a class of bimodal distributions. It 
may be noted that bimodality in the income/wealth 
distribution has actually been observed in many 
cases (see e.g., p^). 

It is seen numerically that bimodality appears for 
ci > 0.92 and C2 > 1. Another interesting fea- 



To model the savings behavior of the agents, we now 
make the following assumptions. 

(i) The agents do not perform static optimization. 

(ii) There is reinforcement in their decision-making 
process. 

(iii) The agents look for better payoffs. But eventually 
each of them converges to a single and simple strat- 
egy or thumb rule. 

To incorporate the three above-mentioned assumptions, 
we model the agents' saving behavior by Polya's urn pro- 
cess The model is as follows. Consider the i— th 
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FIG. 5: 

The savings distribution by reinforcement. Four cases are 
shown. Case A: a=l, b=l. Case B: a— 2, b=2. Case C: a=4, 
b=4. Case D: a=4, b=2. The sohd and the dotted hues 
show the theoretical results (the P{a,h) distributions). 



FIG. 7; 

The steady state money distributions for two cases:- [A) 
a — b; a, 6— >■ oo and (B) a— 4, 6=4. Note that case (A) is 
identical to CC model with A — 0.5. All simulations are 
done for 0(10"") time steps with 100 agents and averaged 
over 0(10'^) time steps. 




FIG. 6: 

The steady state money distributions for two cases:- (A) 
a=l, 6=1 and (B) a=4, 6=2. Case (A) produces the same 
distribution of money as the CCM model (slope -2 in log-log 
plot) whereas in case (B) we get a distribution with slope -3 

in the log- log plot. The lines drawn have slopes -2 and -3 
respectively. All simulations are done for 0(10*') time steps 
with 100 agents and averaged over 0(10'') time steps. 



agent. The choice is binary, he can take any of the two 
decisions, to consume (c) or to save (s). His strategies 
(c and s) such that c, s = 0, 1 and c + s — 1. At each 
instant, he chooses the values for c and s. Define Ct (St) 
as the number of times c (s) has been assigned a value of 
unity in t time periods. The savings propensity at time t 
(that is At) is defined as the ratio of St to {St + Ct). We 
can assume that initially Sq = a and Cq — b. The rein- 
forcement mechanism is incorporated by assuming that 
the probability of choosing s = 1 at any time t + 1^ is 
simply At. Basically, it is the Polya's urn model and the 
famous result that follows from it is the following (Ref. 
[T3|). The random variable At converge almost surely to 
a limit A. The distribution of X is P{a,b). (See Fig. [S]). 



A. Two limits 

(i) (a—b—l): From the above result. At converges to A 
where A ~ uni[0,l]. The resultant distribution of 
money follows a power law. This is the basic CCM 
model. See Fig. [SI 

(ii) {a=b; a,b-^ oo): At converges to A where A is a 
delta function at 0.5. This corresponds to a special 
case of the CC model where A — 0.5. See Fig. [71 



B. For moderate values of a and 6 

Clearly, (l<a, b<oo): This model gives the gamma- 
like part as well as the Pareto tail of the income/money 
distribution for different values of a and b. For example, 
we show the results of two cases. 

(i) (a=4, 6=2): The resulting distribution of savings 
propensity is clearly ^(4,2). The distribution of 
money in the steady state follows a power law with 
a slope -3 in the log-log plot. See Fig. [6l 

(ii) {a— 4, 6=4): The resulting distribution of savings 
propensity is /?(4,4). The distribution of money in 
the steady state is gamma function-like. See Fig. 

m 



VI. FROM MANY TO ONE ... 

In Section [Vl we have discussed how one can derive a 
set of distributed savings propensities starting from a 
unique value. Here, we discuss the reverse side of the 
same coin. We shall show that the agents with different 
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savings propensities, can converge to a single value over 
time. 

To model this situation, we assume that the agents treat 
savings propensity as a strategy which evolves over time. 
A very simple rule of evolution is the following. The 
winner in any trade retains his strategy whereas the loser 
adopts the winner's strategy. Note that by winning in a 
trading action, we simply imply that the agent who gets 
the lion's share in that particular trading is the winner. 
Since it is a relative term, (by refering to EqnI5]) winning 
is determined by the value of the stochastic term e. If 
e > 0.5, then the i-th agent wins (in Eqn. [2]) else the 
j-th agent wins. Note that the most important support 
of this type of strategy evolution comes from the third 
observation by Flache and Macy noted in Section HVl 
Let us assume that the possible saving propensities are 
finite and denoted by Ai, A2, etc. Also, let us de- 

note the number of agents with Ai savings propensity at 
time t by ni{t) (for i= 1, k). At each time-period two 
of the agents are randomly selected and they trade ac- 
cording to Eqn. [5] and then the loser adopts the winner's 
savings propensity. This process is repeated untill the 
sytem reaches a steady state in terms of savings propen- 
sities. After the whole system becomes steady with the 
agents with a fixed saving propensity, the system is al- 
lowed to evolve further to reach a steady state in terms 
of money. 



A. Convergence in savings propensity 

Let 

fc 

Y^nM^N, (3) 

as the total number of agents remains fixed over time 
(recall that ni{t) has been defined above as the number 
of agents with a particular savings propensity Ai). The 
agents only shift from one savings propoensity to another 
over time. Note that at each (trading) time point, the 
number of agents with a particular savings propensity 
rises or falls by unity with equal probability (i.e. depend- 
ing on whether e > 0.5 or not) or it remains unchanged 
if its agents are not selected to trade. To put it formally, 
let us assume that the two agents selected two trade have 
savings propensities Ai and Xj respectively. Then 

ni{t + 1) = ni{t) ± 1 with equal probability (4) 

n,{t + 1) + nj{t + 1) = ni{t) + nj{t) (5) 



nk{t + l) = nk{t) for ah i,j. (6) 




0.1 I > > 1 1 > 1 1 1 

2000 4000 6000 8000 10000 12000 14000 16000 
time 

FIG. 8; 

The convergence in savings propensity. As examples, three 
cases are shown. To study the phenomena of convergence in 

the savings propensities we focus on the fluctuation of the 
average savings propensities. Initially all agents are assigned 

with uniformly distributed savings propensities. Hence the 
average savings propensity is initially very close to half. But 
over time it evolves to reach a steady state where it 

maintains a fixed value indicating that all the agents have 
the same savings propensity. Thereafter the system behaves 
like the usual CC model. 



Hence, the number of agents with a particular savings 
propensity performs a random walk of unit step and also 
note that the walk is bounded below since rii > for all 
i and also above by Eqn. [31 In fact, the formulation is 
akin to the n-players ruin problem |16| where the random 
walk occurs on a simplex given by Eqn. [S] The general n- 
players ruin problem is very difficult to solve analytically 
for fc > 4. Ref. [l^ presents a matrix-theoretic approach 
to the problem which reduces the complexity of the com- 
putation. However, we are not interested in finding the 
exact solutions to the problem. We simply note that the 
given enough time the system will ultimately evolve to a 
state where there is only one savings propensity and this 
is not unique. It can be any of the initial AiS (i — 1, 2,,, 
k). See Fig. E 



B. Steady state money distribution 

Once all the agents have a single savings propensity, 
the system then behaves like the CC model (see Fig. [Ij. 



VII. SUMMARY AND DISCUSSION 

The kinetic exchange models have been very successful 
in explaining the origin of the gamma function-like dis- 
tribution and the power law in the income/wealth distri- 
bution. However, these models use the notion of savings 
extensively on an ad-hoc basis without offering much the- 
oretical understanding of it. The aim of the present paper 
is to provide support to the kinetic exchange models by 
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deriving and explaining them from standard neo-classical 
economics paradigm and the not-so-standard models of 
reinforcement learning and strategic selection. 
Ref. Q provides a microeconomic basis for the kinetic 
exchange models with homogenous agents. Here, we ex- 
tend that model to explain the heterogenous exchange 
models where the agents have different savings propensi- 
ties (Sec. ini. A further possibility is investigated in Sec. 
Illll where the savings propensity of an agent is dependent 
on the money holding of that particular agent and hence 
it changes over time (as the money holding changes). It 
is shown that even in that case, the economy organizes 
itself in such a way that the distribution of money be- 
comes stable over time. In some cases, the distribution 
produces bimodality. Bimodal income/wealth distribu- 
tions have indeed been seen in many countries (see e.g., 
Ref. [13,]). 

However, it is also noted in Sec. IIVI that the market 
clearing, competitive models used extensively in the eco- 
nomics literature has been criticised on the grounds of 



limitations of computational capability of human beings 
(see e.g., |9|]). So we try to explain the kinetic exchange 
models assuming that the agents follow some simple rules 
of thumb. It is shown that the mechanism of reinforcing 
one's own choice leads to the CCM model ^ (Sec. El. 
The basic result regarding the distribution of the fixed 
points follows from the famous Polya 's Urn problem (Ref. 
|14|). Next, we show in Sec. I VII that the agents following 
a simple rule of thumb of selecting the best strategy leads 
to the CC model (Ref. 0). The game of strategy selec- 
tion reduces to the generalized Gambler's Ruin problem 
or the N -player Ruin problem (Ref. [l6j). 
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